floating point
Từ liên quan
fixed pointarithmeticbinarybitbytemantissaexponentsignprecisionfloatdoubledecimalnumberdigitcomputationalgorithmprocessorhardwaresoftwarememoryregisteroverflowunderflowroundingtruncationerroraccuracyapproximationscalarvectormatrixtensorcompilervariableconstantintegerfractionreal numberrational numberirrational numberbaseradixnormalizationbit depthcoprocessorinstruction setlatencythroughputperformancecalculationsimulationgraphicsrenderingdata typecastingconversionepsilonmagnitudebitmaskendiannessarchitecturelogic gatecircuitry